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' In this paper we revisit the relation between the Friedmann equations and the first law 

I of thermodynamics. We find that the unified first law firstly proposed by Hayward to treat 

, the "outer" trapping horizon of dynamical black hole can be used to the apparent horizon 

I ' (a kind of "inner" trapping horizon in the context of the FRW cosmology) of the FRW 

' universe. We discuss three kinds of gravity theorties: Einstein theory, Lovelock thoery and 

scalar-tensor theory. In Einstein theory, the first law of thermodynamics is always satisfied on 



(N 

> 



the apparent horizon. In Lovelock theory, treating the higher derivative terms as an effective 
. energy-momentum tensor, we find that this method can give the same entropy formula for the 

' apparent horizon as that of black hole horizon. This implies that the Clausius relation holds 

for the Lovelock theory. In scalar-tensor gravity, we find, by using the same procedure, the 
, Clausius relation no longer holds. This indicates that the apparent horizon of FRW universe 

O . in the scalar-tensor gravity corresponds to a system of non-equilibrium thermodynamics. We 

show this point by using the method developed recently by Fling et al. for dealing with the 



f{R) gravity. 



X 

H I. INTRODUCTION 



Quantum mechanics together with general relativity predicts that black hole behaves like a 
black body, emitting thermal radiations, with a temperature proportional to its surface gravity at 
the black hole horizon and with an entropy proportional to its horizon area . The Hawking 
temperature and horizon entropy together with the black hole mass obey the first law of black 
hole thermodynamics {dM = TdS) The formulae of black hole entropy and temperature have 
a certain universality in the sense that the horizon area and surface gravity are purely geometric 
quantities determined by the spacetime geometry. 

Since the discovery of black hole thermodynamics in 1970's, physicists have been speculating 
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that there should be some relation between the thermodynamic laws and Einstein equations. Oth- 
erwise, how does general relativity know that the horizon area of black hole is related to its entropy 



equations from the proportionality of entropy to the horizon area, A, together with the fundamen- 
tal relation (Clausius relation) 5Q = TdS, assuming the relation holds for all local Rindler causal 
horizons through each spacetime point. Here 6Q and T are the variation of heat flow and Unruh 
temperature seen by an accelerated observer just inside the horizon. More recently, Eling et al. 
have found that one can not get the right equations of motion for f{R) gravity if one simply uses 
the Clausius relation and the entropy assumption S = af'{R)A. In order to get the equations of 
motion, an entropy production term has to be added to the Clausius relation. They have argued 
that this corresponds to the non-equilibrium thermodynamics of space-time Q]. It is interesting to 
see whether the non-equilibrium thermodynamics is needed in other gravity theories. In this paper, 
we will discuss the scalar-tensor gravity by following [sl. By using entropy assumption S = aF{cj})A 
in the scalar-tensor gravity and Clausius relation with an appropriate entropy production term, 
we can obtain correct equations of motion for the scalar-tensor gravity. This suggests that for the 
scalar-tensor gravity the non-equilibrium thermodynamics also has to be employed to derive the 
dynamic equations of motion of space-times. 

On the other hand, most discussions of black hole thermodynamics have been focused on the 
stationary black holes. For dynamical (i.e., non-stationary) black holes, Hayward has proposed a 
method to deal with thermodynamics associated with trapping horizon of a dynamic black hole 
in 4-dimensional Einstein theory 0,0,0,0]. In this method, for spherical symmetric space-times, 
Einstein equations can be rewritten in a form called "unified first law" . Projecting this unified first 
law along trapping horizon, one gets the first law of thermodynamics for dynamical black hole. A 
definition of energy-supply, ^, is introduced in the unified first law. It is an energy flux defined 
by energy- momentum tensor of matter. After projecting along a vector ^ tangent to trapping 
horizon, one finds {A^,^) = ■^^{dA,^) . This equation can be regarded as the Clausius relation of 
the dynamical black hole. The Friedmann-Robertson- Walker (FRW) universe is one kind of non- 
stationary spherically symmetric space-times. Certainly, we can discuss its thermodynamics on the 
trapping horizon. However, in the FRW universe, the trapping horizon ("outer trapping horizon") 
is absent, instead there exists a kind of cosmological horizon like trapping horizon ("inner trapping 
horizon" ) . This horizon coincides with the apparent horizon in the context of the FRW cosmology. 
In this paper, we therefore do not distinguish them. We will focus on this apparent horizon and 
discuss associated thermodynamics. An interesting question is whether the field equations for non- 
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Einstein gravity can be written to a form as the unified first law in Einstein gravity. We do not try 
to resolve this issue, instead we rewrite the field equations for non-Einstein gravity to a form of the 
Einstein gravity by introducing an effective energy-momentum tensor. Thus, we can use unified 
first law to non-Einstein gravity theories and get the thermodynamics of apparent horizon in the 
FRW universe in those theories. As a result, we have the equation (A^,^) = ■g^{dA,S,) even for 
the non-Einstein gravity theories. But, the energy-supply ^ here includes the contribution of the 
effective energy-momentum tensor. 

In order to get the heat 5Q (defined by integration of pure matter energy flux) in the Clausius 
relation, we have to extract the contribution of pure matter fields from the {A^, ^) in the left 
hand side of the equation {A^,£^) = -^^{dAjS^) and put the others into the right hand side of the 
equation. Now, does the right hand side of the equation have the correct form of TdS in Clausius 
relation? If the answer is yes, the Clausius relation holds and we are treating equilibrium thermody- 
namics. On the contrary, if the answer is no, the Clausius relation in equilibrium thermodynamics 
does no longer hold, and we have to treat the system with non-equilibrium thermodynamics. In 
this paper, we will use this idea to treat the Lovelock gravity and scalar-tensor gravity. We find 
that the Clausius relation holds in Lovelock gravity, while it breaks for the scalar-tensor gravity. 
We will also show this point by using the method of Eling et al. developed for the f{R) gravity [5]. 

There exist some works dealing with the relation between the Einstein equations and the first law 
of thermodynamics. In a setup of a special kind of spherically symmetric black hole spacetimes, 
Padmanabhan et al. [10^ showed that the Einstein equations on the black hole horizon can be 
written into the first law of thermodynamics, dE = TdS — PdV. This also holds in Lovelock 
gravity In the setting of FRW universe, some authors investigated the relation between the 

first law and the Friedmann equations describing the dynamic evolution of the universe . In 



particular, Cai and Kim in 



12l | derived the Friedmann equations by applying the fundamental 



relation 6Q = T6S to the apparent horizon of the FRW universe with any spatial curvature and 
assuming that the apparent horizon has temperature and entropy 

- ' sA (1.1) 



2t:Ra G 

where Ra is the apparent horizon radius. Further they showed that using the same procedure, the 
Friedmann equations can be also derived in the Gauss-Bonnet gravity and more general Lovelock 
gravity. For the scalar-tensor gravity and f{R) gravity, the possibility to derive the corresponding 



Friedmann equations in those theories was investigated in 



13l |. More recently Akbar and Cai 



14j 



have shown that at the apparent horizon, the Friedmann equation can be written into a form of 
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the first law of thermodynamics with a volume change term, not only in Einstein gravity, but also 
in Lovelock gravity. 

This paper is organized as follows. In Sec. II, we give a brief review on the unified first law by 
generalizing it to (n + l)-dimensional Einstein gravity. In Sec. Ill, we consider a FRW universe 
and give the projection vector which will be used in the following sections. In Sec. IV, we give the 
rigorous first law of thermodynamics on the apparent horizon for the FRW universe in Einstein 
theory. In Sec. V, we treat the thermodynamics of apparent horizon in the Lovelock gravity and 
find that the Clausius relation holds for the Lovelock gravity. In Sec. VI, we discuss the scalar- 
tensor gravity and show that the Clausius relation no longer holds. In Sec. VII, we derive the 
equations of motion for the scalar-tensor gravity by using the method of Eling et al. developed for 
dealing with the f{R) gravity. We end this paper with conclusion in Sec. VIII. 



II. A BRIEF REVIEW ON THE UNIFIED FIRST LAW 



Hayward has proposed a general definition of black hole dynamics on trapping horizon in four 
dimensional Einstein theory [a, Q, Is, Iq]. In this section, we will make a brief review and generalize 
his discussions to the (n -|- l)-dimensional Einstein gravity. 

For an arbitrary (n -|- l)-dimensional spherical symmetric space-time, locally we can put its 
metric in the double-null form 

ds'^ = -2e-f di+dC + r^dill_^ , (2.1) 

where is the line element of an (n — l)-sphere with unit radius, r and / are functions of 

Certainly, there are some remainder freedoms to choose the double- null coordinates. 
Assume that the space-time is time-orientable, and d± = d/d^^ are future-pointing. Considering 
radial null geodesic congruence, from ds'^ = 0, one can find that there are two kinds of null geodesies 
corresponding to = constant and = constant, respectively. It is easy to get the expansions 
of these two congruences 

0^ = (n-l)—. (2.2) 

r 

The expansion measures whether the light rays normal to the sphere are diverging {9± > 0), or 
converging {9± < 0), or equivalently, whether the area of the sphere is increasing or decreasing in 
the null directions. 

A sphere is said to be trapped, untrapped or marginal if (on this sphere) 

e+e->o, e+e-<o, or e+9- = o. (2.3) 
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Note that 

^^'Sar^fer = ^^., eVM- , (2-4) 
(n — Ij^ 

we can write this definition to be 

g^''dardbr<0, g^'dard^r > 0, g'^'dardbr = . (2.5) 

If Oj^O- is a function with nonvanishing derivatives, the space-time is divided into trapped and 
untrapped regions, separated by marginal surface. Some subdivisions may be made as follows. 

(i) A trapped sphere is said to be future, if 6*^ < {d±r < 0) and past if 9± > {d±r > 0). 

(ii) On an untrapped sphere, a spatial or null normal vector z is outgoing if {dr, z) > and 
ingoing if {dr, z) < 0. Equivalently, fixing the orientation by locally 0+ > and 9^ < 0, z is 
outgoing if g{z, d-^-) > or g{z, 9_) < and ingoing if g(z, 3+) < or g{z, c?_) > 0. In particular, 

and d- are, respectively, the outgoing and ingoing null normal vectors. 

(iii) A marginal sphere with 0+ = is future if 6- < 0, past if 0_ > 0, bifurcating if 0_ = 0, 
outer if 5-0+ < 0, inner if c?_6'_|_ > and degenerate if = 0. 

The closure of a hypersurface foliated by future or past, outer or inner marginal sphere is called a 
(nondegenerate) trapping horizon. 

In the works of Hayward, the future (past) outer trapping horizon is taken as the definition of 
black (white) holes, i.e., on the marginal sphere of trapping horizon, we have 

e+ = 0, 6'_ < 0, d-6+<0, (2.6) 

or equivalently 

d+r = 0, 5_r < 0, d-d+r < . (2.7) 

However, in the FRW universe, we will treat a horizon which is similar to cosmological horizon 
in the de Sitter space-time. In this case, the surface gravity is negative. So, we need not the 
requirement of "outer". In fact, we will take the future inner trapping horizon as a system on 
which the thermodynamics will be established. 

The Misner-Sharp energy [?, 1^, [3] is defined to be 

^ = T7r7T(™ - l)^n-ir"-2(l - g'^'dardtr) . (2.8) 

This energy is the total energy (not only the passive energy) inside the sphere with radius r. It 
is a pure geometric quantity. From the definition, the ratio E/r"'~'^ controls the formation of 



black and white holes and trapped sphere generally There are a lot of definitions for 

energy in general relativity, such as, ADM mass for asymptotically flat space-time, Bondi-Sachs 
energy defined at nu^ 
Yau energy etc. 
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1 infinity of the asymptotically fiat space-time, Brown- York energy jind Liu- 

3- 
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201, 



2M- The 



These definitions can be found in a recent review 
physical meanings of Misner-Sharp energy, and the c omp arison of Misner-Sharp energy to ADM 
mass and Bondi-Sachs energy have been given in [3, lisl - For spherical space-time, Brown- York 
energy agrees with the Liu- Yau energy, but they both differ from the Misner-Sharp energy. For 
example, for the four dimensional Reissner-Nordstrom black hole, the Misner-Sharp energy differs 
from the Brown- York or Liu- Yau mass by a term which is the energy of the electromagnetic field 
inside the sphere. The Misner-Sharp energy has the relation to the structure of the space-time and 
one can relate it to Einstein equations (see Eq. (|2.1ip below). This is an important advantage of 
Misner-Sharp energy. 

From the energy- momentum tensor Tab, we can give two useful invariants — work and energy- 
supply: 

W = -^tracer = -5+_T+" , (2.9) 

^a = Tj'dbr + Wdar. (2.10) 

By using the Misner-Sharp energy and these two quantities, one can find that the (0, 0) com- 
ponent of Einstein equations can be written as 

dE = A"^ + WdV , (2.11) 

where A = r2„_ir"^"^ and V = j^Qn-if"^ with ^n~i = 27r"/^/r(n/2) are area and volume of 
a sphere with radius r. Equation (|2.11|) is called unified first law. It is the natural result of 
Einstein equations for spherical symmetric space-times. The unified first law (j2.1ip contains rich 
information. After projecting it along different directions, this equation gives different meanings. 
For instance, (i) projecting the unified first law along the future null infinity, one has the Bondi 
energy loss equation; (ii) projecting the unified first law along the fiow of a thermodynamic material 
yields the first law of relativistic thermodynamics; (iii) projecting the unified first law along the 
trapping horizon, one obtaines the first law of black hole thermodynamics. Here, we will concentrate 
on the first law of black hole thermodynamics, which has the form 

{dE,z) = -!^{dA,z) + W{dV,z), (2.12) 
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where k is the surface gravity of the trapping horizon, and is defined by 

K=^V''Var, (2.13) 

where V corresponds to the covariant derivative of two dimension space normal to the sphere, and 
z is a vector which is tangent to the trapping horizon (Certainly, z is not arbitrary and must satisfy 
some conditions on the trapping horizon). In the double null coordinates, z can be expressed as 

z = z+d+ + z-d-. (2.14) 

The equation ()2.12p is obtained through projecting the unified first law along the vector z. The 
nontrivial part is to show 

{A^,z) = ^{dA,z). (2.15) 
As mentioned above, we take the horizon to be 

d+r = 0. (2.16) 

Then, one has on the marginal sphere, 

z^daid+r) = z+d+d+r + z-d-d+r = . (2.17) 

Using Einstein equations and the definition of surface gravity, one can arrive at (I2.15p . The most 
important thing is to note that z is not arbitrary, on the trapping horizon it must satisfy the 
equation above, then 

Therefore z belongs to the one dimensional subspace of the tangent space. The projection along z 
replaces the extra differential by the differential of state space for black hole, one can arrive at the 
exact first law of the trapping horizon thermodynamics of dynamic black holes Q]. This equation 
(j2.18p plays a curial role to get the projection vector. We will give this ratio for the FRW universe 
in the next section. 

III. TRAPPING HORIZON AND APPARENT HORIZON OF THE FRW UNIVERSE 

Now, we consider an (n + l)-dimensional FRW universe. We put the FRW metric in the form 

ds"^ = hahdx^dx^ + r'^dQi_^ (3.1) 



where = t, = r, f = ar is the radius of the sphere and a is the scale factor. It should be noted 
here, that f = f{t, r) plays the role of sphere radius r defined in the previous section. Defining 

where k is the spatial curvature parameter of the FRW universe, we can put the FRW metric into 
a double-null form 

ds^ = -2di^dC + r'^dnl_i . (3.3) 

It is easy to find 

where the minus signs ensure that d± are future pointing. The trapping horizon, we denote it by 
VA, is defined to be 



(3.5) 



Solving this equation, one finds 



1 



f\ = / , . (3.6) 

This radius has the same form as apparent horizon [l^. It is not surprised because the trapping 
horizon and apparent horizon coincide with each other in the FRW universe. On the other hand, 
we have 

d^r\f=f^ = -2fAH < , (3.7) 
that is, this trapping horizon is future. A similar calculation on the trapping horizon gives 

d^d+f\f^ = 2f A (^H + 2H^ + ^) , d+d+r\fA = '^rA " ^) • (^-S) 
By definition, one can find the surface gravity 



Further, we define 
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Here, we assume e < 1 such that k < 0. In another words, we are treating an "inner" trapping 
horizon, rather than "outer " trapping horizon (with positive surface gravity) discussed by Hay- 



ward. Note that in references 
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12l |. in fact, an approximation e <C 1 has been used in calculating 
the energy flow crossing the apparent horizon. In the present paper, no any approximation will be 
used. In terms of the horizon radius r^, we have 

H-^ = -^. (3.11) 



Substituting this into (|3.8p . we get 

z+ d-d+r 1 — e ' 
Let = 1, then z~ = in the coordinates (t,r), we then can express z as 



(3A2) 



where we have used the relation 



on the trapping horizon. Thus, if we use the (t, r) coordinates instead of double-null coordinates, 
any project vector ^ must have the form 

? = ^* f4 - (1 - 2e)i?r|-') . (3.15) 



dt dr ^ 

Certainly, we can choose ^* = 1. All calculations in this section are pure geometrical. Therefore 
the results in this section are applicable for the FRW universe in any gravity theory. 

IV. THERMODYNAMICS OF APPARENT HORIZON IN EINSTEIN GRAVITY 

Consider a Lagrangian for an (n -|- l)-dimensional Einstein gravity with perfect fluid 

1 m 

£ = ;^ii+£. (4.1) 

m 

where C denotes the Lagrangian for the perfect fluid. In the FRW universe, the energy-momentum 
tensor of the perfect fluid has the form 

m 

Tab =Tab= {Pm + PmWaUb + Pm9ab , (4.2) 
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where pm and pm are the energy density and pressure of the perfect fluid, respectively. It is easy 
to find that the energy-momentum tensor projecting onto two dimensional space-time normal to 
the sphere has the form 

2 

Tab = diag(pm, .^""^ n ), Ta'' = diag{-pm,Pm)- (4.3) 
1 — kr^ 

and then the work term and energy-supply are 

W = ^{pm-Pm), (4.4) 

"^1 = -^{pm+Pm)Hr, (4.5) 

"^r = ^{Pm+Pm)a, (4.6) 



respectively. One then has 



m = ^^^^dt + "^rdr = -^{pm + Pm)Hfdt + ^{prn+Pm)adr . (4.7) 

Thus, on the trapping horizon/apparent horizon we have 

dE = + WdV = + AWdrA 
= -A{pm + Pm)HrAdt + ApjndrA 

= Vdpm + PmdV = d {pmV) . (4.8) 

Substituting the first Friedmann equation {H'^ + k/a^ = 167rGpm/{n{n — 1))) into the last line in 
the above equation, one can get nothing but the differential of the Misner-Sharp energy. On the 
other hand, if use the Misner-Sharp energy (j2.8p inside the apparent horizon with the radius ()3.6p . 
the above equation (j4.8p tells us nothing, but the first Friedmann equation 



1| 



Let be a vector tangent to the apparent horizon, which can be expressed as (I3.15p . From now 
on we choose ^* = 1, thus we have 

{dE, = -AHfA [(1 - 2€)pm + Pm)] . (4.9) 

On the other hand, 

d^ = -(n-l)(l-e) ^^^ {HfAdt + adr). (4.10) 



By using Friedmann equation, we have 



" {dA,0 = -{n-l)2e{l-e)-47ZTHrA 



-{l-e)AHfA{Pm+Pm). (4.11) 
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Similarly, one can show 

{WdV, = eAHfAiPm - Pm) . (4.12) 

Combining them yields 

{dA, + {WdV, = -Am A [(1 - 2e)pra + Pm)] ■ (4.13) 



SvrG 

Thus we have shown that the unified first law on the inner trapping horizon has the form 

{dE,i) = ^{dA,i) + {WdV,i). (4.14) 

Here some remarks are in order, (i) The unified first law ()2.1ip is not a real first law of thermody- 
namics, but just an identity concerning the (0, 0) component of Einstein equations. However, the 
projection of the unified first law along a trapping horizon (or apparent horizon in FRW cosmology 
context) gives a real first law of thermodynamics, (ii) The Misner-Sharp energy plays an impor- 
tant role in the unified first law and the definition of work and energy-supply is very useful. The 
separation of work and energy-supply gives a very similar form as the first law of thermodynamics 
before projecting it along the horizon, (iii) On the horizon, the energy-supply has the form 

{A^,i) = ^{dA,i) (4.15) 

This is the Clausius relation in the version of black hole thermodynamics. The left hand side of 
the above equation is nothing but heat flow 6Q deflned by the matter energy-momentum tensor. 
The right hand side has the form TdS if one identities that temperature T = k/2tt and S = A/ AG. 
Thus we conclude that in Einstein theory, the unifled first law also imples the Clausius relation 
6Q = TdS. (iv) For the FRW cosmology in Einstein theory, the Misner-Sharp energy inside the 
trapping horizon is E = PmV (see (|4.8p ) — the energy density times the volume. This energy form 
for the FRW cosmology in Einstein theory is very special. In general, the Misner-Sharp energy has 
no such a form in other gravity theories, which will be seen in next sections. 

V. THERMODYNAMICS OF APPARENT HORIZON IN LOVELOCK GRAVITY 



The Lagrangian of the Lovelock gravity 
sities 



231] consists of the dimensionally extended Euler den- 



£ = j;^qa, (5.1) 



i=0 
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where Cj is an arbitrary constant, m < [n/2] and £j is the Euler density of a 2z-dimensional manifold 

r .— ^ xaibi -aibi jjcidi nCidi 

Cq corresponds to the cosmological term. Ci is just the Einstein-Hilbert term, and £2 corresponds 
to the so called "Gauss-Bonnet" term. Although the Lagrangian of the Lovelock theory contains 
higher curvature terms, there are no terms with more than second order derivatives of metric in 
equations of motion. This point can be directly found from the equations of motion 

m 
1=0 

If we introduce matter fields, the equations of motion become 

m ^ 

^b - Z^-^(>bcidi-c,d,-^ aibi---n a,b, - OTTCxJ^ . (bA) 
1=0 

In the FRW cosmology, the energy-momentum tensor is still taken to be that of perfect fluid. We 
can put this equations of motion into the standard form in Einstein gravity by moving those terms 
except the Einstein tensor into the right hand side of the equation 

/ m e \ 

Gt = 87TG(T,- + Tn , (5.5) 



where the effective energy-momentum tensor has the expression 

e m 

rpa _ ^ ST^ _2]_s:aaibi---aibi Tjcidi TjCidi (^^ R\ 

i=0,i^l 

In the FRW metric, some non-vanishing components of Riemann tensor have the forms 



(5.8) 



Substituting these into (|5.6p . we have 
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(5.9) 



where 
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The work term can be decomposed as 



m e 

w =w + w. 



(5.11) 



where 

m \ , m 1 e IlG 

W= --/l"" Tab= 2 (Pm - Pm) , W= --/l"" Tab 

The higher curvature terms produce the effective work term 



W 



^ lit 

1 \ ^ Ci 

8^ 2" 

i=0,i^l 



H 



Similarly, the energy-supply ^ can also be divided into 

m e 
^ = + ^ , 

where 



(5.12) 



(5.13) 



(5.14) 



(5.15) 



After some calculations we arrive at 



ml 1 

^' = --{pm+Pm)Hfdt + -ipm + Pm)adr , 



(5.16) 



m 



levrG ^ 

i=0,i^l 



j-1 



1 



levrG 



E 



5- ( ff' + 4 

n 



i-l 



(5.17) 



i=0,i^l 

Thus, we have put the Lovelock theory into the form of Einstein theory with an effective energy- 
momentum tensor, and the effective energy-momentum tensor has been used in the work and 
energy-supply terms. These imply that the unified first law discussed previously is applicable as 
well here and the energy has the form of the Misner-Sharp energy ([2 



The Friedmann equations of Lovelock gravity read [ij] 

i=0 ^ ^ ' 



(5.18) 



1=0 



Id 



H 



r, 



(5.19) 
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Using the Friedmann equations and the work and energy-supply terms given above, one can obtain 
the differential of the Misner-Sharp energy from the unified first law. Turn around, if we use the 
Misner-Sharp energy and work and energy-supply terms, we can obtain the Friedmann equations 
in the Lovelock gravity from the unified first law. An interesting point is here that for the Lovelock 
gravity, we can not put the Misner-Sharp energy inside the trapping horizon into the form E = PmV 
since the effective energy-momentum tensor will make a contribution to the energy inside the 
horizon |l^. Projecting the unified first law along the trapping horizon, we have 

K 



{dE,0 



-{dA,0 + {WdV,0, 



(5.20) 



SvrG 

since we have written the equation of motion for the Lovelock gravity to the form of Einstein 
gravity. This projection implies that we have 



SttG 



{dA,0- 



Namely, we have 



SvrG 



{dA,0-{A^,0 



(5.21) 



(5.22) 



Clearly, the left hand side is just the "energy-supply" projecting along ^, which is nothing, but 
the heat flow 6Q defined by pure matter energy-momentum tensor. Thus, an interesting question 
is whether the right hand side of the equation can be of the form TdS in the Clausius relation as 
the case in Einstein gravity? The answer is yes: the right hand side of the equation can indeed be 
written to a form with the surface gravity times the differential of the entropy in Lovelock theory 

e 

projecting along ^. Now we show this. From the definition of ^, we have 



SvrG 



{dA,0-{A^i>,0 



A 



ATTGf\ 



e{l-e){n-l)HfA 



A 

4^' 



:e(l 



tin 



1)1 



i=0,i^l 

Having considered ci = 1, we can rewrite the above equation into 



{n-2i)l 



HrA. 



(5.23) 
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{dA,0-{A^,0 



6(1-6) 



i=0 



Ci 



A 

2=U L 



i{n - 1)! / 1 



{n-2i)\ \fl 



HrA 



m 



27r " ^MG^ 

i=0 



^4G ^ 

i(n — 



■ i{n-V)\ 2i 



{n-2i)\ ^ 



dfA,0 



1)1 



A 



4G 



i=0 



(n-2ii + l)! 
i(n-l)! . 



,0 



2-2i 



{n-2i + l)\ ^ 



,0 



T{dS,0, 



(5.24) 



15 



where T = Hi/2iT and 



S 



A ^ 
4G^ 



i=Q 

e 



11! 



'{n-2i + l)\ ^ 



(5.25) 



Thus we have shown that -^^{dA, ^) — {A^i, ^) is exactly the surface gravity times a total differential 
projecting along the tangent direction of the trapping horizon. This total differential is nothing 



12,04, 



but the differential of the horizon entropy defined in Lovelock gravity 

Above discussions tell us: In Lovelock gravity, if one uses the pure matter energy-momentum to 

m e 

define 6Q, i.e., 5Q = (A^,^), then ^^{dA,^) - is of the form TdS. That is, the Clausius 

relation 6Q = TdS still holds in Lovelock gravity. 

An interesting question arises: does the Clausius relation always hold for any gravity theory? 
In the next section, using the method developed in this section, we will show that the Clausius 
relation does not hold in the scalar-tensor theory. 



VI. THERMODYNAMICS OF APPARENT HORIZON IN SCALAR-TENSOR 

GRAVITY 

In the Jordan frame, the Lagrangian of the scalar-tensor gravity in (n + l)-dimensional space- 
times can be written as 

jC- = T^F{^)R - \g^'dM^ - Vi^) + Cm , (6.1) 
IfavrG 2 

where -F((/>) is an positive continuous function of the scalar field (p and V{(1>) is its potential. Varying 
the action, we have the equations of motion 

FGab + gab^^F - VaVbF = SttG ( Tab + Tab ) , (6.2) 

V2^-y (^) + _l^F'((/<)i? = 0, (6.3) 

where Tab is the energy-momentum tensor of matter. We denote Tab by 

Tab= da(t>db(t> - gab {^g''' dc<i>dd(t> + V{<t>)^ ■ (6.4) 

Note that here Tab is not the energy-momentum tensor of the scalar field. As the case of Lovelock 
gravity, in order to use the unified first law in Einstein gravity, we rewrite the equations of motion 
into the following form 

1/0 rn ex 

Gab = SnGTab = SvrG- ( Tab + Tab + Tabj, (6.5) 
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where 

Tah= (-^aftV'F + VaVbF) . (6.6) 

In the FRW metric, it is easy to find that V^-F and the non-Vctnisliiiig compoii6nts of ^ cLtb 



V^F = -F-nHF, VtVtF = F, VrVrF = -—^—rHF , (6.7) 

1 — kr'^ 

respectively. We then have 

The work term can be decomposed as 

4> m e 

W=W + W + W, (6.9) 

with 

</> m 1 

W + W= —{p<p + Pm - P<p - Pm) , (6.10) 



2 



where 



P4> = l<i>'' + Vi(t^), p^ = \4>^-V{(l>). (6.12) 



Similarly, the energy-supply have the form 



with 



4> m e 

*=* + ^' + ^', (6.13) 



* + *= --^{p<p + Pm + P4> + Pm)Hfdt + —{p4, + pm+P4>+Pm)adr, (6.14) 

fF - Hf) Hfdt + — (f - Hf) adr . (6.15) 

On the trapping horizon/apparent horizon, the unified first law tells us 

dE = + WdV = + AWdfA 
A , 

' - {P<t> + Pm + P<t> + Pm)HfAdt + (p0 + pm)dfA 

A_(^F-HF^HfAdt-^nHFdfA ■ (6.16) 
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By using Friedmann equations, one can find that dE is nothing but the exterior differential of the 
Misner-Sharp energy 

On the other hand, if substituting the Misner-Sharp energy, work and energy-supply terms defined 
above into the unified first law (16.161) . we can obtain the Friedmann equations in the Scalar- Tensor 

n 

gravity [13l |: 

^n{n - 1)F (^H^ + ^) + = ^vrG (p^ + p„) , (6.18) 

-in- 1)F (^H-^^-{F- HF) = SttG {p^ +p^ + Pm+ Pm) , (6.19) 

where p^j, and p^f, have the same form as (j6.12p . Since we have rewritten the equations of motion of 
the scalar-tensor gravity into a form as in Einstein theory, the following equation should hold 

{dE, = ^{dA, + {WdV, ■ (6.20) 
where W is given by (|6.9p . Further we have 

{A^,0 = £^{dA,0, (6.21) 
where ^ is given by (j6.13p . Substituting ^ into the above equation, we have 

F{A 1 + F{A ^, = -^{dA, - F{A 1, . (6.22) 
The left hand side of this equation can be explicitly expressed as 

0ml 1 

F{A qf, + F{A qj, = (--(P0 + Pm+P<p+ Pm)Hrdt + -{p^ + Pm+P^ + Pm)adr, £) . (6.23) 

This is just the energy-supply term provided by matter and the scalar field. We denote it by 6Q 
as the case in Einstein gravity. Can we put the right hand side of equation (j6.22p into a form with 
the surface gravity times a total differential projecting along the vector ^ as the case of Lovelock 
gravity? The answer is no in the present case. To see this, let us note that the right hand side of 
the equation can be expressed as 

{dA, - F{A 1, = A{n - l)2eHrA - ^A^a (f - Hf) Hva 



A f F 

1g 



T{dS, + T—r\ i^-HF + H^F], (6.24) 
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where 

K F{(j))A 
T=-, S = ^^. (6.25) 

Here S has the form of the entropy of black holes in the scalar-tensor gravity [2] • Thus equation 
(|6.22p can be reexpressed as 

6Q = TdS + TdiS , (6.26) 

where 

The equation (|6.26p implies that the Clausius relation 6Q = TdS does not hold for the scalar- 
tensor gravity. The term diS in (j6.27p can be interpreted as the entropy production term in 
the non-equilibrium thermodynamics associated with the apparent horizon. Indeed, in Einstein 
gravity, Jacobson [4] used the Clausius relation 5Q = TdS and derived the Einstein field equations. 
However, recently Eling et al. have found that the Clausius relation does not hold for the /(.R) 
gravity, and that in order to obtain the equations of motion for the f{R) gravity, an entropy 
production term has to be added to the Clausius relation like (j6.26p . In the next section, following 



IE 



|5|, we will show that indeed for the scalar-tensor gravity, an additional entropy production term 
is needed for deriving the equations of motion. 

VII. SCALAR-TENSOR GRAVITY AND NON-EQUILIBRIUM THERMODYNAMICS 



In 



a, 



Jacobson derived Einstein equations from the proportionality of entropy to the horizon 
area, ^4, together with the fundamental Clausius relation 5Q = TdS, assuming that the relation 
holds for all local Rindler causal horizons through each space-time point. Here 5Q and T are 
the variation of heat and Unruh temperature seen by a accelerated observer just inside the hori- 
zon. Recently, Elingei al. [5j] have shown that the Clausius relation plus the entropy assumption 
S = aAf'{R) can not give the correct equations of motion for the f{R) gravity. In order to get cor- 
rect equations of motion, one has to modify the equilibrium Clausius relation to a non-equilibrium 
one; an entropy production term needs to be added to the Clausius relation of equilibrium ther- 
modynamics. Namely, the f{R) gravity corresponds to a non-equilibrium thermodynamics of 
space-time. In this section, we will deal with the scalar-tensor gravity by using their method. 

For a space-time point p in (n + l)-dimensions, locally, one can define a causal horizon as in Q]: 
Choose a spacelike (n — l)-surface patch B including p and the choose one side of the boundary 
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of the past of B. Near the point p, this boundary is a congruence of the null geodesies orthogonal 
to B. These comprise the horizon. To define the heat flux, we can employ an approximate boost 
killing vector x which is future pointing on the causal horizon and vanishes at p. x has a relation 
with the tangent vector of causal horizon k: x = — A/c, where A is the affine parameter of the 
corresponding null geodesic line. The heat is defined to be the boost energy current of matter 
(including the scalar field in the scalar-tensor gravity) across the horizon 

SQ = j TabX^di:'. (7.1) 

Using relation x = — AA:, and temperature T = h/2'K, we have 

j Tabk^k\-\)d\(P-^A, (7.2) 



5Q _ 2tt 



where 



(j> m 

Tab =Tah + Tab ■ (7.3) 
Assuming that the entropy is of the form 

S = aF{(l))A, (7.4) 
where a is a constant depending on the number and nature of quantum fields, we have 

6S = a f {eF + F)dX(P-^A , (7.5) 



where 6 is the expansion of null geodesic congruence and the overdot means the derivative with 
respect to the affine parameter A (do not confuse with the derivative with respect to t in the 
previous sections). To extract the 0(A) term from the integrand, we differentiate it with respect 
to A and use the requirement Q]: {OF + F){p) = 0, at the point p, we have 

-^{eF + F)\x=o = eF-F~^F^ + F. (7.6) 

By using Raychaudhuri equation for the null geodesic congruence in (n + l)-dimensions 

d a _ ^ q2 ab Tj laib 



UabCy'"' - Rabn' (7.7) 



dX n — 1 

and the geodesic equation, we can rewrite equation ()7.6p as 

- k^k'iRab - VaVbF + F-^VaFVbF) - -^FO^ - F<Jab<J^^ . (7.8) 

n — 1 
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We assume that the shear term vanishes in the whole space-time. With the Clausius relation, we 
have 

n 2tt ™ 

FRab - Va^bF + -F~^VaFVbF + <^>gab = (Tab + Tab). (7.9) 

n — 1 ah 
where <1> is an undetermined function and Tab= da4>db4> — Qab {^9'^'^dc4>dd4> + V{(f))) . We assume 

m 

that the matter stress tensor is divergence free, i.e., Tab= 0, but due to the coupling function 

<!> 
F{(f>) between cf) and scalar curvature R, the Tab is not conserved, namely, V" Taby^ 0. Instead the 



divergence of Tab is 

V''Tab=V''(^Vb(^-V'{(^)Vb(^. (7.10) 

Considering the identity 

V'^iFRab - VaVbF) = ^Vb{FR) - Vb^^F - ^RF'Vb<P (7.11) 
and taking divergence for both sides of the equation (j7.9p . we find 



Vft$ = Vfo ( V^F - Ifr] -V" 



2 \n 



-^F-^VaFVbF) 
n — 1 J 



1 27r ,„2 



The last term in the right hand side of the above equation is nothing, but the equation of motion 
for the scalar field. Therefore this term always vanishes. While the left hand side is a pure gradient 
of a scalar, the second term in the right hand side of the equation V" ^^^;^F^^VaFVb-F\can not 
always be written as the gradient of a scalar. As a result, as the case of /(i?) gravity j5|, there 
is a contradiction here. To resolve this, we add an entropy production term diS to the Clausius 
relation. It is easy to find if we choose 

d,S = j adXd'^-^A (7.13) 

with entropy production density 

a = aF'^F^X (7.14) 

n — 1 

and use the equation of motion for the scalar field 

^F'r+^(v^cP-V')=0, (7.15) 



2 ah 

The field equations (j7.9p for the scalar-tensor theory become 



27r ,J J? 



FGab - VaVbF + gabV'F = —{Tab + Tab) , (7.16) 
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where Gab is the Einstein tensor. Taking a = equations (|7.16p and (j7.15p are just the equations 
of motion for gab and (j) in the scalar-tensor gravity theory, whose Lagrangian is given by (|6.ip . 

Thus we conclude that in order to get the equations of motion in the scalar-tensor gravity, the 
Clausius relation has to be modified; we have to add an entropy production term diS (j7.13p to the 
Clausius relation. This suggests that as the case of f{R) gravity, the scalar-tensor gravity corre- 
sponds to non-equilibrium thermodynamics of space-time. We note that this entropy production 
term (j7.13p does not coincide with the entropy production term (j6.27p in the setup of the FRW 
universe although they look similar to each other. This is not surprised because the analysis of El- 
ing et al. is locally at each space-time point, while our previous analysis is focused on the trapping 
horizon/apparent horizon of the FRW universe. The common point between them is that both of 
them imply that the scalar-tensor gravity requires a non-equilibrium thermodynamic treatment as 
the f{R) gravity. 



VIII. CONCLUSIONS 



In this paper we have revisited the relation between the Friedmann equations and the thermo- 
dynamics on the trapping horizon/apparent horizon in the FRW universe. We have generalized 
the unified first law to the case of (n + l)-dimensional Einstein theory. After projecting the uni- 
fied first law along "inner" trapping horizon/apparent horizon, we have obtained the first law of 
thermodynamics of the FRW universe, which is very similar to the thermodynamics of dynamic 
black holes on their "outer" trapping horizon. The form of the first law of thermodynamics is 
rigorous without any approximation. For non-Einstein gravity theories, we have rewritten the field 
equations to a form of Einstein gravity by introducing an effective energy-momentum tensor and 
treated them as Einstein gravity theory. In these theories the first law of thermodynamics for the 
apparent horizon in the FRW universe has the same form 

{dE,0 = ^{dA,0 + {WdV,0. 

where E is the Misner-Sharp energy, as the case of Einstein gravity theory. But here W is an 
effective work term, the Misner-Sharp energy is fixed to be the form of equation (j2.8p because it 
is defined through space-time geometry. In the Lovelock gravity, if we define the heat 6Q by pure 
matter energy-supply projecting along the horizon, we find that the Clausius relation 



5Q = TdS 
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still holds, where T = K/27r and S is of the exact form of the entropy of black hole horizon in 
the Lovelock gravity. However, the same treatment tells us that the Clausius relation can not be 
fulfilled for the scalar-tensor gravity. We have to introduce an entropy production term to the 
Clausius relation 

5Q = TdS + TdiS. 

This implies that the thermodynamics of apparent horizon is a non-equilibrium thermodynamics 
for the scalar-tensor theory. 

Following Eling et al. [51] , we have treated the scalar-tensor gravity and shown that the Clausius 
relation plus the entropy form S = aF{(f))A can not give the correct equations of motion for the 
theory. In order to resolve this issue, we have to modify the Clausius relation by introducing an 
entropy production term. This also indicates that the scalar-tensor gravity is the non-equilibrium 
thermodynamics of spacetime as the case of f{R) gravity. 
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